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Image processing method, system and examination apparatus for extracting a threadlike 
structure in a noisy digital image 



The invention relates to an image processing method for extracting a 
threadlike structure represented on a background in a noisy digital image. In particular, the 
invention concerns an image processing method for extracting the pixels representing a 
guide- wire in an X-ray fluoroscopy medical image. The invention also relates to a system for 
5 carrying out the method and to an examination apparatus having means for image processing 
and display. 

The invention is applied to the industry of medical imaging. 
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yj 10 An image processing method for extracting a catheter guide-wire is already 

disclosed in a US patent n° 5 289 373 5 (Zarge et alii). This document relates to a method 

and an apparatus for real-time tracking of a catheter guide-wire in fluoroscopy images during 

p interventional radiological procedures. This method comprises a first step of pixel-wise 

P s s extraction for determining whether or not each pixel should be labeled as a possible guide- 

Is— 

U! 15 wire point and forming an image called binary peak image; a second step of chain model 

S3SO, 

y[ construction followed by an identification of a guide-wire model as the most promising path 

among previously determined chains; a third step of superimposition of the guide-wire model 
onto the live fluoroscopic images. The first step is an iconic process that deeply exploits the 
outputs of several first and second order linear operators. The second step is non-iconic. It 
20 relies to morphological operations and to chain and tree oriented methods. 



The present invention has for an object to provide a method which can be 
carried out automatically in real time, with a substantial gain of speed with respect to the 
25 method known of the state of the art, together with higher sensitivity and selectivity, thus 
while considering using processing means having speed of the kind which is presently used 
in the state of the art. 
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An image processing method, which solves this problem, is claimed in Claim 
1 . A system for carrying out the method is claimed in Claim 16 and an examination apparatus 
is further claimed in Claim 12. 

The invention is described hereafter in detail in reference to the diagrammatic 
and schematic figures, wherein: 

Fig. 1 A is a functional block diagram of the main steps of the method; 
Fig. IB and Fig. 1C are functional block diagrams of particular steps of the 

method; 

Fig. 2A is an original image representing a guide-wire on a background; 

Fig. 2B illustrates the detection of elementary strings of pixels in the image of 

Fig. 2A; 

Fig. 2C is an enlarged part of Fig. 2B; 

Fig. 3 A illustrates the output of the Intra-set Phase of the method; 
Fig. 3B illustrates the operation of the Extra-Set Phase; 
Fig. 3C illustrates results of said Extra-Set Phase 

Fig. 3D illustrates elimination of spurious string parts using said Extra-Set 

Phase; 

Fig. 3E is a final image; 

Fig. 4A and Fig. 4B illustrate a system and an examination apparatus. 

The invention relates to an image processing method for extracting a 
threadlike structure represented on a background in a noisy digital image. In an example, the 
threadlike structure is a guide-wire represented on the background of a medical fluoroscopy 
arteriogram image, which is a digital image formed with a low level of X-rays. It results that 
this fluoroscopy digital image is noisy. In this example, the method has for an object to 
extract the guide-wire pixels in order to improve its visibility in the arteriogram image. In 
cardiology, sequences of X-ray arteriogram images are used to visualize in real time medical 
procedures of introducing a catheter in a vessel. Such medical procedures deeply rely on the 
correct visibility of the guide-wire, which is a metallic wire introduced in the vessel for 
guiding the catheter. Improving the visibility of the guide-wire permits of avoiding damaging 
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the vessel while moving the catheter in the vessel. In an other example, the threadlike 
structure is a thin vessel in an arteriogram image. 

Fig. 1 A shows diagrammatically the main steps of a processing method for 
extracting a threadlike structure represented on the background of a noisy digital image 
called original image IM1. The following process is completely described by its functioning 
on only one image. However, the processing method is appropriate to be carried out in real 
time, that is to say at a frame rate of about 16 to 25 images per second, if the processing 
means used for its implementation is appropriate. 

Step 1 : Image acquisition 

Fig. 2 A shows a digital photo called original image IM1, representing a 
threadlike structure in black on a noisy dark background. Referring to Fig. 1 A, in a first step 
of the method, the image data of said original image are acquired. These data contain 
intensity and co-ordinate information associated to the image pixels. 

Step 2 : Preliminary extraction of elementary strings. 

The image IM1 comprises different structures such as ridges, or instead 
troughs, and textures. A positive image is considered as a 3-D picture, having two 
dimensions for the co-ordinates of pixels and a third dimension for the intensity signals 
associated to said pixels. A ridge is a crest-like structure formed by adjacent pixels having 
intensity signals that are maximum in a neighborhood, said pixels having specific 
dispositions the ones with respect to the others resulting in specific gradient values with 
respect to orientations. A ridge pixel shows a low intensity gradient in a first determined 
direction in its neighborhood, and shows an intensity gradient that is maximum in a direction 
perpendicular to said first direction. The more a given structure is formed of pixels verifying 
this gradient property, the more the ridgeness measure of the structure is high. Instead of 
ridges, troughs can be considered in a negative original image IM1 for instance obtained by 
x-ray imaging. In an x-ray negative image, a guide-wire is a dark structure on a lighter 
background. In this case, the calculations for extracting the guide-wire have for an object to 
extract trough pixels, which can be determined by measures similar to ridgeness calculations. 
In ridgeness calculations applied to troughs determination, the estimation of specific intensity 
gradients that is required for characterizing ridges is still valuable for characterizing troughs. 
So, in the description of the present method, these calculations are called "ridgeness" 
calculations, whether they are applied to ridges or troughs in the original image IM1. 

Referring to Fig. 2B, in said preliminary extraction step 2, without prior 
information other than the image data of IM1, a technique, which is based on the operation of 
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ridge-filters for detecting ridge pixels and on a connectivity analysis for connecting the 
detected ridge pixels, produces elementary strings of pixels, which are associated to form 
string sets, such as string sets SA, SB and SC. Within a string set, all the elementary strings 
are assumed to belong to the same threadlike structure. For instance, as shown in Fig. 2C, 
which is an enlarged part of Fig. 2B, in string set SA, elementary strings Al, A2, A3, A4 are 
assumed to belong to the same threadlike structure. The resulting image is called string set 
image IM2. At the end of this step 2, actually, the threadlike structure is not yet perfectly 
extracted. The image IM2 shows the five following defects: 

1) Within a string set, for example string set SA, some of the elementary 
strings do not belong to the threadlike structure. So, probably, the elementary string A4 does 
not actually belong to the threadlike structure of SA. 

2) Within a string set, all the elementary strings do not continuously cover the 
threadlike structure. Hole artifacts are seen for example in string set SA, between the 
elementary strings Al, A2, between the elementary strings A2, A3, between the elementary 
strings A4 and other elementary strings. 

3) Elementary strings belonging to different string sets might belong to the 
same threadlike structure. For example, the elementary strings present in string sets SA and 
SB might belong to the same threadlike structure. 

4) In the case when string sets SA and SB belong to the same threadlike 
structure, then, linking parts of strings are missing between them. 

5) Some string sets may not belong to the actual threadlike structure and 
should be eliminated. This might be the case of string set SC. 

So, the present method of image processing has further steps to improve the 
image of Fig. 2B and correct the above-cited defects. 

Step 3 : Ridgeness calculation : 

Referring to Fig. 1 A, the method comprises a step 3 of "ridgeness" calculation 
applied to the string set image IM2. This "ridgeness" calculation is performed by applying on 
the pixels of the image of Fig. 2B, filters known as ridge-filters, which determine the pixels 
of the ridge structures, or of the troughs, according to the case of positive or negative 
processed image. Based on this ridgeness calculation, each pixel of the string set image IM2 
is further associated to a ridgeness data. The resulting image is called ridgeness image IM3. 

Step 4 : First Phase = Intra-Set Phase 

Referring to Fig. 1 A and to Fig. IB, which is a block diagram of step 4, the 
method specifically comprises a First Phase called "Intra-Set Phase", which is applied to the 
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image IM3 of set of elementary strings where the pixels data (co-ordinates and intensities) 
are associated to the ridgeness data, and which has for an object to provide one only Best 
String per string set by correcting the above-described defects 1 and 2 that are respectively : 
spurious elementary strings inside a given string set and hole artifacts inside said given string 
set. These defects can be found in each set of strings. The spurious elementary strings and the 
holes must be automatically eliminated inside each string set. In said Intra-Set Phase, each 
string set is considered separately. For instance, the string set SA of Fig. 2B is first 
considered. This string set SA includes elementary strings Al, A2, A3, A4. This Intra-Set 
Phase comprises several sub-steps: 

Referring to Fig. IB, in a first sub-step 41 of the Intra-Set Phase, the End- 
Points of each elementary string are calculated from the image data of string set SA and 
denoted API, AP2, AP3, AP4, APS, AP6, AP7, AP8. The elementary strings are set of 
pixels connected to one or to two neighbors. On a given elementary string, for example Al, 
there are only two pixels that have only one neighbor : the pixels API, AP2, which are the 
End-Points of the elementary string Al. 

In a second sub-step 42 of the Intra-Set Phase, a First Image of Potentials 
called IP1 is calculated where : the potentials of the pixels belonging to the considered string 
set, for example string set SA, are set to first values, favorable to a further operation of Front 
Propagation, lower than a predetermined potential value, the potentials of pixels of the other 
string sets, in that case, string sets SB, and SC, are set to second values, unfavorable to said 
Front Propagation, higher than the given predetermined value, and the pixels located outside 
the string sets are attributed potentials whose values are function of their ridgeness data 
values. The more important the ridgeness, the lower the attributed potentials. 
In a third sub-step 43 of the Intra-Set Phase, a Front Propagation operation is performed to 
supply Candidate Paths, using a Front Propagation technique, which forms paths only with 
pixels that have low Potential values. The Front Propagation technique is performed between 
all the couples of End-Points that are possibly found in the considered string set, for example 
string set SA, one End-Point being considered a starting pixel and the other End-Point being 
considered the last pixel of the constructed path. So, several paths, referred to as set of 
Candidate Paths, are formed from the image of potentials IP1. In the set of Candidate Paths, 
forming a Candidate Paths image IM4, the number of Candidate Paths is equal to the number 
of couples of End-Points in the considered string set. 

As an example, a front propagation technique is disclosed in a publication 
entitled "A fast marching level set method for monotonically advancing fronts" by J. A. 
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SETHIAN in Proc. Nat. Acad. Sci., USA, Vol. 93, pp. 1591-1595, February 1996, Applied 
Mathematics. According to said reference, a front, formed in a 2-D grid of potential values, is 
propagated using a "Fast Marching Technique" with a determination of the front points. The 
front is a solution of a so-called Eikonal Equation. The Fast Marching Technique introduces 
order in the selection of the grid points and sweeps the front ahead in one pass on the 2-D 
image. The Fast Marching Technique comprises marching the Front outwards by freezing 
already visited points denoted Alive, coming from a set of points referred to as Narrow Band, 
and by bringing new ones denoted Far Away into said Narrow Band. The Narrow Band grid 
points are always up-dated as those having minimal potential values in a neighboring 
structure denoted Min-Heap and the potential of the neighbors are further re-adjusted. Said 
Fast Marching technique provides one path of minimal cost joining the start point to 
respectively each point of the front, said front propagating until the end point is reached. 
Then, the minimal path is provided by back-propagating from the end point to the start point 
by the steepest gradient descent in the convex surface. The numerous paths constructed by 
propagating the front forwards and joining the start point to the different points of the front 
for forming the convex surface are no more taken into account. Even the path joining the start 
point to the end point, in the operation of forwarding the front, is not the steepest gradient 
descent in the back-propagation operation. It is interesting to note that the points of a path 
constructed in the operation of marching the front forwards are points which have the 
smallest possible potentials. Starting at the start point, and going forwards from one point to 
the next point must be at the "minimal cost". So, such a path is a path of "minimal Action", i. 
e. a path on which the "Sum" or the "Integral" of potentials calculated over point potentials is 
the smallest though strictly continuously growing as a function of the number of points 
present on said path between the start point and the current point on the front. This technique 
needs one Starting End-Point and one Final End-Point to propagate the Front. 

In a sub-step 44 of the Intra-Set Phase, one only Path is selected among the set 
of Candidate Paths as the Best Path for forming one only Best String per string set and for 
representing the threadlike structure in the considered string set. This step is preferably 
performed by using a criterion based on the cumulated ridgeness values calculated along the 
Candidate Paths and by selecting the Best Path for which the cumulated ridgeness value is 
the highest. 

By the above-described technique of selection of the Best Path among a set of 
Candidate Paths, small paths are eliminated and the path along which the answer of ridgeness 
is the highest is selected as Best Path. This step of Best path selection is illustrated by Fig.3A, 
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where, in string set SA, only one Best String denoted A is selected and the other Candidate 
Paths are eliminated. 

In the Intra-Set Phase, the sub-steps one to four are applied to all string sets 
present in IP1. The resulting image is called Intra-Set image INSI. If, for instance, only one 
5 String Set has been found, then the Best String may constitute the Final Threadlike Structure. 
Step 5 : Second Phase = Extra-Set Phase 

Referring to Fig. 1 A and to Fig. 1C, which is a block diagram of step 5, the 
method specifically comprises a Second Phase called "Extra-Set Phase", which is applied to 
the image INSI of the Best Strings in the case of several String Sets, and which has for an 
10 object to provide one only Final Best String from said Best Strings by correcting the above- 
cited defects 3 to 5 respectively : holes between two Best Strings belonging to the same 
threadlike structure and Best Strings that eventually do not belong to said threadlike 
structure. For example, as shown on Fig. 3B, three Best Strings A, B, C have been obtained 

GJ from the Intra-Set Phase and they are not linked. Also, the Best String C seems far from the 

Ln 

Oil 5 other Best Strings. The holes must be automatically filled between Best String belonging to 
the same threadlike structure and the spurious Best Strings must be automatically eliminated 
outside the previously defined string sets . Only one Final Best String GW must be formed 
from said three Best Strings in a resulting image called Extra-Set image EXSI, for 
representing the threadlike structure. 
U120 Referring to Fig. 1C, in a first sub-step 51 of the Extra-Set Phase, the data 

£7 relating to these Best Strings A, B, C and the location of their End-Points denoted API, AP6 
for A and BP1, BP2 for B, are issued from the Best String image INSI in order to be 
processed. 

In a second sub-step 52 of the Extra-Set Phase, a second Image of Potentials, 
25 called IP2, is calculated from the Intra-Set image INSI, where : all the string pixels are 

attributed high potentials, and the other points generate a lower potential with respect to a 
given predetermined potential value. The purpose of this Extra-Set Phase is no longer to 
perform a Front Propagation along the already estimated Best Strings; instead a Front 
Propagation is required between the End-Points of the Best Strings in order to connect said 
30 Best Strings. It is the reason why the string pixels are attributed high potentials. 

Referring to Fig. 3B, which shows an enlarged part of Fig. 3 A, in a third sub- 
step 53 of the Extra-Set Phase, a Front Propagation operation is performed on the points 
external to the Best Strings in the second image of potentials IP2. This Front Propagation 
operation comprises a predetermined number of iterations, which operation covers a surface 
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denoted SF, which is delimited by the front of the propagation and which comprises pixels of 
the second Image of Potentials IP2. This Front Propagation starts at one End-Point of one 
first Best String, for example AP6 of Best String A, and propagates in the continuation of 
Best String A, opposite to said Best String A. Said surface SF is defined by a parameter of 
the Front Propagation, which is predetermined for assuring that the Best Strings linked by 
this operation belong to the same threadlike structure, thus forming an image IMS. 

In a fourth sub-step 54, said surface SF is examined in the image IMS, in 
order to determined whether End-Points relating to other Best Strings are found inside the 
surface. There may be one or several End-Points besides the starting End-Point, found in said 
surface. For instance, the End-Point BP1 is found as illustrated by Fig. 3B. The Front 
Propagation operation produces respective Connection Paths linking the starting End-Points 
to the found End-Points, in an image IM6. 

In a fifth sub-step 55 of the Extra-Set Phase, a Best Connection Path LK 
among these several respective Connection Paths is selected using a criterion preferably 
based on the ridgness data as illustrated by Fig. 3C. For instance, the Best Connection Path 
LK1 links the End-Point AP6 of A to the End-Point BP1 of B. 

Referring to Fig. 3C, the third sub-step 53, the fourth sub-step 54 and the fifth 
sub-step 55 of the Extra-Set Phase are performed between all the Best Strings previously 
determined in the second Potential image IP2, by taking the still free End-Points as starting 
End-Points until all the Best Strings that may possibly be connected using the above- 
described Extra-Set Phase are linked. As the surface SF determined by the Front Propagation 
operation is limited, some Best Strings might be too far from given starting End-Points to be 
reached by said surface SF. So, when there are Best Strings still isolated at the end of the 
Extra-Set Phase, they are eliminated. By using the Extra-Set Phase, more than one Final Best 
String FBS may be produced. If so, again a ridgeness criterion taking into account shape 
parameters such as length and intensity parameters are used to select the Final Best String to 
represent the threadlike structure GW. The experience shows that usually only one string, 
which is substantially longer and more contrasted than other structures, is found at the end of 
the Extra-Set Phase and that the last selection operation is easy to perform without ambiguity 
for providing GW in EXSI. Fig. 3E is a digital photo showing the extracted guide-wire in 
white instead of black for contrast and visibility. 

It is important to note that, depending on the original image, on the one hand, 
the First Phase called Intra-Set Phase is able to provide directly the whole and complete 
threadlike structure when uniquely applied to the elementary strings forming one set of pixel 



; PHFR000047 

9 18.04.2001 
strings : the resulting Best String is the extracted threadlike structure. And, on the other hand, 
the Second Phase, called Extra- Set Phase is able to provide directly the whole and complete 
threadlike structure when uniquely applied to the elementary strings, each elementary string 
being in this case directly considered as a Best String and processed as such to provide the 
5 Final Best String for forming the extracted threadlike structure. 

Referring to Fig. 4 A, 4B, an X-ray medical examination apparatus 150 
comprises means for acquiring digital image data of a medical image, and a digital 
processing system 120 for processing these data according to the processing method 
described above. The X-ray apparatus comprises an X-ray source 101, a table 102 for 
10 receiving a patient to be examined, an optical system 103, 104 for providing image data to 
the processing system 120 which has at least one output 106 to provide image data to display 
and/or storage means 107. The display and storage means may respectively be the screen 140 
Jri and the memory of a workstation 130. The display means may comprise a screen to display 
03 the medical original images and the processed medical images, in such a way that the 

?-? s .... 

jj|15 displayed processed images may help the practitioner during a medical act. Said storing 
means may be alternately external storing means. 

f y 

yQ The image processing system 120 may be : a suitably programmed computer 

p of the workstation 130, or a special purpose processor having circuit means such as LUTs, 

Memories, Filters, Logic Operators, that are arranged to perform the functions of the method 

U120 steps according to the invention. The workstation 1 30 may also comprise a keyboard 131 and 

O 

T\ a mouse 132. 
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